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A quantum fluctuation theorem for a driven quantum subsystem interacting with its environment 
is derived based solely on the assumption that its reduced density matrix obeys a closed evolution 
equation i.e. a quantum master equation (QME). Quantum trajectories and their associated entropy, 
heat and work appear naturally by transforming the QME to a time dependent Liouville space basis 
that diagonalizes the instantaneous reduced density matrix of the subsystem. A quantum integral 
fluctuation theorem, a steady state fluctuation theorem and the Jarzynski relation are derived in a 
similar way as for classical stochastic dynamics. 
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INTRODUCTION 



The fluctuation theorems and the Jarzynski re- 
lation are some of a handful of powerful results of 
nonequilibrium statistical mechanics that hold far from 
thermodynamic equilibrium. Originally derived in the 
context of classical mechanics Q, the Jarzynski relation 
has been subsequently extended to stochastic dynamics 
Q. It relates the distribution of the work done by a 
driving force of arbitrary speed on a system initially at 
equilibrium (nonequilibrium property) to the free energy 
difference between the initial and final equilibrium state 
of the system (equilibrium property). This remarkable 
relation has recently been shown to hold for arbitrarily 
coupling strength between the system and the environ- 
ment (see Jarzynski's reply to criticism from Ref. Q). 
The fluctuation theorems are based on a fundamental 
relation connecting the entropy production of a single 
system trajectory to the logarithm of the ratio of the 
probability of the forward and the backward trajectory 
[5J. The ensemble average of the trajectory entropy 
production is the macroscopic entropy production of 
the system whereas its distribution gives rise to various 
kinds of fluctuation theorems. The first has been derived 
for classical mechanics and initially for deterministic 
(but non-Hamiltonian) thermostated systems 0, 0, H|- 
Some interesting studies of fluctuation relations valid 
for far from equilibrium classical Hamiltonian systems 
have been made even earlier 0, 0, |n|. Fluctuation 
theorems for systems with stochastic dynamics have 
also been developed 0|lEl3|ll|lS|ll|llll3- For 
classical stochastic dynamics, the connection between 
the fluctuation theorem and the Jarzynski relation has 
been established by Crooks 0. Seifert has recently 
provided a unified description of the different fluctuation 
relations and of the Jarzynski relation for classical 
stochastic processes described by master equations [l9} . 
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The understanding of these two fundamental relations 
in quantum mechanics is still not fully established. 
Quantum Jarzynski relations have been investigated 
in [23, El H2 |2^|. Quantum fluctuation theorems 
have been developed only in a few restricted situations 
[O- HE H3 ■ A quantum exc hang e fluctuation theo- 
rem has also been considered in 28] . Some interesting 
considerations on the quantum definition of work in the 
previous studies have been made in |29| . 
It should be noted that the dynamics of an isolated 
(whether driven or not) quantum system is unitary 
and its von Neumann entropy is time independent. 
Therefore, fluctuation theorems for such closed systems 
are useful only provided one defines some reduced 
macrovariable dynamics or some measurement process 
on the system |3fj| . 

The purpose of this paper is to provide a unified 
derivation for the different quantum fluctuation rela- 
tions (an integral fluctuation theorem, a steady state 
fluctuation theorem and the Jarzynski relation). We 
build upon the unification of the different fluctuation 
relations recently accomplished by Seifert for 
classical stochastic dynamics described by birth and 
death master equation (BDME). Quantum evolution 
involves coherences which make its interpretation in 
term of trajectories not obvious. Nevertheless, we show 
that it is possible to formally develop a trajectory 
picture of quantum dynamics which allows to uniquely 
represent entropy, heat and work distributions. This 
rely on the single assumption that the reduced dynamics 
of a driven quantum subsystem interacting with its 
environment is described by a closed evolution equation 
for the density matrix of the subsystem i.e. a QME 
[3lL l32l 1.3.1 l34j. However, while the physical quantities 
defined along classical trajectories are conceptually clear 
and experimentally measurable, how to measure the 
physical quantities associated to quantum trajectories 
remains a fascinating open issue intimately connected to 
quantum measurement. 

The plan of the paper is as follows: We start in sec- 
tion [H] by defining quantum heat and quantum work for 
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a driven subsystem interacting with its environment in 
consistency with thermodynamics . We then discuss the 
consequences of defining heat and work in terms of the 
time dependent basis which diagonalizes the subsystem 
density matrix in section IIIII In section IIVI we show 
that by assuming a QME for the subsystem reduced den- 
sity matrix we can recast its solution in a representation 
which takes the form of a BDME with time dependent 
rates. In section^ we show that the BDME representa- 
tion allows to split the entropy evolution in two parts, the 
entropy flow associated with exchange processes with the 
environment and the entropy production associated with 
subsystem internal irreversible processes. In section IVTl 
we show that the BDME representation naturally allows 
to define quantum trajectories as well as their associated 
entropy flow and entropy production. We then derive the 
fundamental relation of this paper l|67|l which will allow 
us to derive, in section fVIII a quantum integral fluctua- 
tion theorem and, in section lYlIII a quantum steady state 
fluctuation theorem. Having identified in section ITXl the 
heat and the work associated to the quantum trajecto- 
ries, we show in section Ixl that the fundamental relation 
of section IVII also allows to derive a quantum Jarzynski 
relation. We finally draw conclusions in section IXll 

II. AVERAGE HEAT AND WORK 

We start by defining the average quantum heat and 
work for a driven subsystem interacting with its envi- 
ronment and show the consistency of these definitions 
with thermodynamics . Heat and work can be rigorously 
expressed in term of the reduced density matrix of 
the subsystem without having to refer explicitly to the 
environment. 

We consider a driven subsystem with Hamiltonian 
Hg(t). Everywhere in this paper we denote operators 
with an hat (and superators with two hats) and we use 
the Schrodinger picture where the time dependence of the 
observables is explicit and comes exclusively from exter- 
nal driving. We could also have written Hs(X(t)), where 
X(t) is the external time dependent driving. This sub- 
system is interacting with its environment whose Hamil- 
tonian is Hb- The interaction energy between the sub- 
system and the environment is described by Hj. The 
Hamiltonian of the total system reads therefore 

H T (t)=H s (t) + H B + H I . (1) 

We have assumed that the driving acts exclusively on the 
subsystem and does not affect Hb and Hj. 
The state of the total system is described by the density 
matrix p(t) which obeys the von Neumann equation 

m = -i[H T (t),p(t)]=kt)p(t), (2) 

The energy of the total system is given by 

{H T ) t = TrH T (t) P (t) . (3) 



The change in the total energy between time and t due 
to the time dependent driving is therefore given by 

AE T (t) = [ dr^^- = W T (t) + Q T (t) , (4) 
Jo dr 

where the work and the heat have respectively been de- 
fined as 

W T (t) = f dTTrH T (t)p(t) (5) 
J o 

Q T (t) = [ dTTrH T (t)p(t) . (6) 
Jo 

Using the von Neumann equation Q and the invariance 
of the trace under cyclic permutation j3^ , we find that 
no heat is generated in the isolated total system 

Q T (t) = -i [ dTTrH T {t)[H T {t),p(t)] = . (7) 
Jo 

We next turn to the subsystem. Its reduced density ma- 
trix is defined as a(t) = Tr^/5(i) and its energy is given 
by 

(H s ) t = TvH s (t)p(t) = Tr s H s (t)a(t) . (8) 

The change in this energy between time and t is given 
by 

AE s (t) = J dr^^ = W s (t) + Q s (t) , (9) 

where the work and the heat are defined as 

W s (t) = f drTtHs (t) pT (t) (10) 
Jo 

= / dTTr s Hs(T)a(T) 
Jo 

Q s (t) = [ dr TtHs(t)/>t(t) (11) 
Jo 

= / dTTi s H s (T)a(T) . 
Jo 

Since the time dependence of the total system Hamil- 
tonian comes solely from the subsystem Hamiltonian, 

Hb = Hj = 0, Ht = Hs and the work done by the 
driving force on the subsystem is the same as the work 
done by this force on the total system 

W T {t) = W s {t) = W{t) . (12) 

This also means that the energy increase in the subsys- 
tem minus the amount of heat which went to the environ- 
ment is equal to the energy increase in the total system 

W(t) = AE T (t) = AE s (t) - Q s (t) . (13) 

It should be noticed that due to the absence of heat flux 
in the total system Qr(t) — 0, using © with and 
(|TT|l . we can also express the heat going from the subsys- 
tem to the environment as 

QM.-ft^-f (14) 
Jo dr J Q dr 
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III. CALCULATING HEAT AND WORK IN A 
TIME DEPENDENT BASIS 

As will become clear in section IIVI in order to 
associate trajectories to the quantum dynamics, one 
need to represent the dynamics in a time dependent 
basis. This is a fundamental difference from classical 
thermodynamics where the basis set (coordinate system) 
is fixed. In order to associate heat and work with single 
trajectories they must be defined with respect to the 
time dependent basis set. The ensemble average of the 
quantities defined for the trajectories will therefore also 
depend on the time dependent basis set. For this reason, 
we introduce a modified definition of heat and work. 
The effect of the basis time dependence on heat and 
work is given in appendix 1X1 



The energy of the total system © can also be written 



as 



(H T ) t = Y,P?(a)(a t \H T (t)\a t ) 



(15) 



where we have introduced the time dependent basis 
{|at)} which diagonalizes the instantaneous density ma- 
trix at all time 

(a t \p(t)\a' t ) = (a t \p(t)\a t )6 aa , = P^(a)S aa/ . (16) 

The change in this energy between time and t due to 
the time dependent driving can therefore be rewritten as 



AE T (t) = W T (t) + Q T (t) , 



(17) 



where the modified work and heat have respectively been 
defined as 

W T (t) ee jyrY,Pr(a)^(a T \H T (T)\a T )yi8) 

Q T (t) ee f dTy^PJ{a){ aT \H T {r)\a T ) . (19) 

Because the total system is driven but otherwise isolated, 
its evolution is unitary and we have (see appendix lA^I 



W T (t) = W T {t) = AE T (t) 
Q T (t) = Q T (t) = . 



(20) 
(21) 



This means that defining heat and work on the time 
dependent basis which diagonalizes the instantaneous 
density matrix for unitary evolution is equivalent to 
the original definition of heat and work in a time 
independent basis. 

The energy of the subsystem (0 can also be written in 
analogy to (fT5|l as 



(H s } t =^P t {m)(mt\Hs(t)\mt), 



(22) 



where we have introduced the time dependent basis 
{\mt)} diagonalizing the instantaneous subsystem re- 
duced density matrix 

(m t \a(t)\m' t ) = {m t \cr(t)\m t )5 mm ' = Pt(m)6 mm > . (23) 

Let us note for future reference that 



-((m t \a(t)\m' t )) = {m t \&{t)\m' t ) 



(24) 



+ (m t \a(t)\m' t ) + (m t \a(t)\m' t ) . 

Eq. and |23 give 

(m t \a(t)\m' t ) = P t (m)d mm > (25) 
-(ifit\m' t )P t (m') - (m t \rn' t )P t (m) . 

Notice also that for m = m', we have 

{mt\o(t)\mt) =Pt(m) (26) 

because (m t \m t ) + (m t \rn t ) = ^((m t |m t )) = 0. 

Using (j22(l . the change in the subsystem energy between 

time and t can be rewritten as 



AE s (t) = W s (t) + Qs(t) 



(27) 



where the work and the heat are defined in analogy to 
(P) and (EU) as 



W s (t) 



[ dr^P T (m) 
Jo ^ 



dr 



[m T \H s {r)\m T ) (28) 



Q s (t) ee f dT^P T (m)(m T |iJs(r)|m T } . (29) 

It is shown in appendix that the work and heat de- 
fined in the time dependent basis is related to the 
original work and heat defined in any time independent 
basis by 



W s (t) = W s (t) + A s (t) 
Qs(t) = Qs(t)-A s (t) , 



(30) 
(31) 



where 



A s (t) ee f rfr^P T (m) (32) 
{m T \Hs(T)\m T ) + (m T \H s (T)\rh T ) 



It should be emphasized that both the original and the 
modified work and heat of the subsystem can be defined 
exclusively in term of the subsystem quantities without 
refcring explicitly to the environment. 
Using O and (|T3J) with ^ and lEU, we get 

AE T (t) = W(t) = W s (t)-A s (t) (33) 
= AE s (t)-Qs(t)-A s (t) . 
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IV. BDME REPRESENTATION OF THE QME 
SOLUTION 

In this section we show that if we assume a closed 
evolution equation for the subsystem reduced density 
matrix, we can transform it solution in a BDME form 
with time dependent rates. 

We assume that the reduced subsystem density matrix 
&(t) obeys a closed QME. The literature on this topic is 
well furnished [H Hi IH HI • This QME can be derived 
microscopically by perturbation theory like in the Red- 
field theory or using a quantum dynamical semigroups 
approach leadin g to Lindblad type master equations. In 
Liouville space [8fi| . the QME of the externally driven 
subsystem interacting with its environment reads 

\&(t) t(t)\a(t) > . (34) 

If the interaction with the environment vanishes, the 
generator IC(t) becomes the antihcrmitian superoperator 
JC(t) = £s(t) = — l [Hs(t),-] and the evolution superop- 
erator M t defined by |er(t) ^>= M t \<r(0) » becomes the 

unitary superoperator A4 t — exp + {J* cIt£s(t)}. How- 
ever, for non vanishing coupling this generator is not an- 
tihermician and leads to a nonunitary evolution. 
The QME in some given (possibly time dependent) basis 
reads 

< a'\a(t) ^2 < a'\ht)\jj' >< JJ'VW » ,(35) 

where <C J j' | o"(t) S> is the superoperator representation 
of (j\a(t)\j'). Let us now use the time dependent basis 
{|m t }} introduced in Since the QME keeps &(t) 

hermitian, this diagonalization is always possible. 

< m t m' t \a(t) >= P t {m)8 m . m > . (36) 

A crucial property of this basis is that [see Eq. (|26() ] 

P t (m) =< m t m t \a(t) > . (37) 

The consequence of this property is that by defining 

W t (m',m) = < m t m t \t(t)\m' t m' t » , (38) 

and by projecting the QME Ij34(l on the time dependent 
superbra <c m(t)m(t)\ we get 

P t (m)=J2w t {m',m)P t (m') . (39) 

m' 

Since the QME l|34|) preserves probability, we have 
^2 m W t (m' ,m) — and Wt(m',m) real. Therefore, we 
can rewrite 1)390 as 



This equation appears like a BDME but should not be 
viewed as an equation of motion. It is merely a way of 
recasting the solution of the QME (|34(l in a diagonal 
basis. In fact, in order to get the Pt(m)'s and the 
Wt(m' , m)'s, we need to solve the QME first and find the 
time dependent unitary transformation diagonalizing 
the solution a(t) at any time. Eq. (|39|l should therefore 
be viewed as a formal definition of the rate matrix 
Wt(m', m). We will show that Wt(m', m) defined in this 
way can be used to derive quantum fluctuation relations. 
Note that W t (m\m) depends on the subsystem initial 
condition <r(0). 

If the subsystem (driven or not) does not interact with 
the environment, the generator is antihermician and the 
evolution superoperator unitary. In this case \a(t) ^§>— 

Mt \cr(0) ^> and <C m t m t \ =<C too™o| M-^ 1 , so that 

P t (m) = (m |<7(Q)|m ) = P (m) . (41) 

This shows that the Pt(m)'s evolve only if the dynamics 
is nonunitary. 

When there is no driving and the subsystem does in- 
teract with its environment, the dynamics is nonunitary 
and the subsystem will reach equilibrium tr cq on long 
time scales. For an infinite isothermal environment this 
equilibrium state will correspond to the canonical sub- 
system reduced density matrix <r cq = e~P Hs /Z$ where 
Z s = Tr e-P^s and (3 — 1/T {kg = 1). In this case the 
basis diagonalizing <7 cq becomes time independent and 
will also diagonalize the subsystem Hamiltonian so that 
P eq (m) = e~P Em /Zs where E m are the eigenvalues of 
the subsystem Hamiltonian. 

For a subsystem with nonequilibrium boundary condi- 
tions and interacting with its environment, the subsystem 
can reache a steady state a st on long times. In this case 
the matrix diagonalizing the density matrix is again time 
independent and both the probabilities Pt(m) = P st (m) 
and the rates Wt{m',m) = W st (m',m) become time in- 
dependent. 



V. ENTROPY FOR QUANTUM ENSEMBLES 

In this section we define the von Neumann entropy 
associated with the subsystem and separate its evolution 
into two parts: the entropy flow associated to the heat 
going from the subsystem to the environment and the 
entropy production associated to the internal (always 
positive) entropy growth of the subsystem. 

The von Neumann entropy of the subsystem is defined 

by 



P t {m)= {W t (m\m)P t (m')-Wt(m,m')P t (m)}(AO) S(t) = -Tr a(t) In &(t) = -^P t (m) In P t (m) (42) 
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Using Eq. I|40JI. we can write its time derivative as 

S{t) = -^P t (m)lnP t (m) (43) 

m 

- - ^ P t (m)W t (m, m 1 ) In P * ^ } (44) 



m , m ' 



P t (m) 



In analogy with [Tsl ITsT ] for classical systems, this can be 
partitioned as 



S(t) = S e {t) + Si(t) 



(45) 



where 
S e (t) = 

and where 
Si(t) 



E 

m,m' 



P t (m)W t (m,m') In ^{"^ , (46) 
Wt(m, to) 



E„/ > . ,. , Pt(TO)IU t (TO, to') . . 
P(m)Wf(m,m') hi „ , J, A -( 47 ) 



P t (m')Wt(m', to) 



As a consequence of the inequality (R1—R2) ln(Pi /P2) > 
0, we notice that Si(t) > is an always positive quantity. 
We will therefore identify it with the entropy production. 
The remaining part of the entropy S e {t) is thus associ- 
ated with the entropy flow to the environment since in 
thermodynamics the entropy evolution is partitioned in 
the (reversible) entropy flow to the environment and the 
(irreversible) entropy production [23, H3 . To further ra- 
tionalize this identification, let us assume that WAm, to') 
satisfy the detailed balance condition 0, |3^, |3!| . For 
isothermal environments at temperature T, the detailed 
balance condition with respect to H s (t), which means 
that the non-driven subsystem tends to thermal equilib- 
rium at long time, reads 

W t{m,m') = e p( {mtl H s{ t)\ mt )-( m ' t \Hs(t)\,n' t )) _ / 48 n 

Wt{m' ', to) 

Noticing that the heat Q29f) can be rewritten as 



Q(t) 



Pt(m)(m t \Hs(t)\mt) 



(49) 



Pt(m)W t (m,m') 



= -T 



E 

m,m' 



(m t \H s (t)\m t ) - (m' t \H s (t)\m' t ) _ 

e P(m t \Hs(t)\m t ) 

Pt(m)W t (m, to') In ■ 



,(3(m' t \Hs(t)\m' t ) 



and using (|46|l . the immediate consequence of (|48() is that 
the entropy flow is equal to the modified heat going from 
the subsystem to the environment divided by the envi- 
ronment temperature as expected from thermodynamics 



S e (t) 



T 



(50) 



This motivates our partition of the entropy (|45|l and the 
definition of the modified heat in section ITTT1 

We can further show that the entropy flow is associated 
to reversible entropy variations. In the thermodynamical 
sense, a reversible transformation is a one during which 
the entropy production is zero Si(t) = 0. This property 
holds provided the following condition is satisfied [see 

63] 



Pt(m)W t (rn, to') = Pt{m')Wt(m' , to) . 



(51) 



Using now Ea. H48|l . we find that for a reversible transfor- 
mation the subsystem has to be at all time in the time 
dependent state 



P(m) 



-0(m t \H s (t)\mi) 

e -f3(rn t \H s (t)\m t ) 



(52) 



This state correspond to the instantaneous Gibbs state 
of the subsystem a(t) = e~P Hs ^ /Z$- In this case 
{|to) 4 } in Ea. l|51() becomes the adiabatic basis (basis 
diagonalizing the subsystem Hamiltonian). We thus 
show that for reversible transformations the probability 
distribution remains Gibbsian along the adiabatic levels. 
Because Si(t) = 0, we also have S(t) = S e (t). Using 
(|48|l , this means that for a reversible transformation the 
change in the entropy of the subsystem result exclusively 

from the heat flow to the environment S(t) = Qs/T in 
consistency with thermodynamics. 

When there is no driving, Eq. (|51|l with Eq. 
(|48|l define equilibrium. At equilibrium we have 
S(t) = Si(t) - S e (t) = 0. 



VI. ENTROPY FOR QUANTUM 
TRAJECTORIES 



In this section we introduce quantum trajectories and 
distributions. We will associate an entropy with these 
trajectories and identify the entropy flow and production 
of these trajectories whose ensemble averages recover 
the entropies discussed in section This will allow us 
to derive a fundamental quantum relation similar to the 
classical relation obtained by Crooks ^3] an d Seifert 
[T^ | connecting the ratio of the probability of a forward 
trajectory and the "backward" one with the trajectory 
entropy production. 

From Eq. (|40l) it seems natural to unravel the evolu- 
tion equation for the probability Pt (to) in the same way 
as is done for classical stochastic processes ^tj. Let us 
consider a stochastic trajectory of duration t which con- 
tains N jumps. Different trajectories can of course have 
a different number of jumps N . t = [0, t] labels time 
during the process, j = 1, . . . , N labels the jumps. The 
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trajectory nc T \ [see Fig. is made by the successive 
states taken by the system in time 



1(t) = n ~* "1 ~ * "2 



(53) 



The system starts in no, jumps at time Tj from rij-\ to 
rij and ends up at time t in tijv- We will denote tq = 
and tat + i = t. 

The entropy associated with the trajectory U( T ) reads 



T] 



T N-j T N-j+l T N-j+2 T N-2 T N-1 T N t 



t t-X, t-T~ t-T^, 



t-i: N-j t_T N-j+l 1 % 



T 3 T, T, 
j+2 t^N-jt- 



FIG. 1: Representation of a quantum forward trajectory n( T ) 
and of the associated pseudo-backward trajectory rim. 



s(t) = -lnP T (n (T) ) 



(54) 



where P T {ni T \) is the solution of Eq. I|4(JI) for an initial 
condition Pq(hq) evaluated along the trajectory nr T ). 
The time derivative of this trajectory entropy 



A' 



d T P T (n) ^ 



Pr(n) 



3=1 



fife) 

P T (n 



3— 1/ 



,(55) 



will be separated as 

s{t) =s e (r)+s 4 (r) , (56) 
where the trajectory entropy flux reads 

• / \ r, m W T (rij-i,nj) /K _, 

s e ( T ) = -z]^ T ~ T ^ ln w „ ' ( 57 ) 



3=1 



W T (nj,nj-i) 



and the trajectory entropy production reads 
d t P T (n). 



Si(r) 



P T (n) 1 <T) 
■^<J(r-r,)ln 

3=1 



(58) 



P T (n j )W T (n j ,nj- 1 ) 
P r (n i _i)W / r (n : ,_i,n J ) 



The ensemble average over the different trajec- 
tories is carried out by using the probability 



P T (nj-i)W T (rij-i,nj) that a transition occurs at 
time Tj between rij-i and rij. We get 



S(t) = (s(r)) 
5 e (r) - (s e (r)) 
Si(r) = («i(r)> 



(59) 
(60) 
(61) 



The probability of a forward trajectory nr T \ starting at 
time and ending at time t is given by 



"f[«(t)] = Po(n ) 



(62) 



Y[ exp I - / dr' ^2 w r' {nj-i, m) j W Tj (%•_!, s 
(- / dT'Y,W T ,(n N ,m)\ . 



exp 



The exponentials represent the probabilities to stay 
in a given state during the time interval between two 
successive jumps, and the transition rates evaluated at 
the jump times give the probability for the jumps to 
occur at this given times. 

Defining the backward process as done for classical 
stochastic dynamics [l9j is not possible. In the classical 
case, it is sufficient after the forward process to revert 
the driving protocol A(r) = A(t — r) and to ask for the 
probability of a backward trajectory (system taking the 
sequence of states of the forward trajectory but in the re- 
versed order) to occur. The reversal of the driving proto- 
col has the consequence of reversing the time dependence 
of the transition matrix W T (m,m') — Wi_ T (m,rn') so 
that the backward process clearly correspond to a phys- 
ical process. However, the time dependence of the quan- 
tum transition matrix Wt(m,m') does not come exclu- 
sively from the external driving force and is different for 
different initial conditions of the subsystem <r(0). There- 
fore, reversing the driving protocol does not simply re- 
verse the time dependence of the transition matrix. Nev- 
ertheless, in order to have a process corresponding to a 
reversal of the time dependence of the transition matrix, 
we will formally define an artificial backward process. 
This definition will allow us to derive important fluctua- 
tion relations in next sections. 

Let us consider a new dynamics in the time interval 
f = [0, t] obeying 



P f ( m ) = ^Wr(m\m)Pr(m?) 



(63) 



where the rates are related to the previous rates in the 
following way 



Wf(m',rh) = Wt-f(rh',rh) 



(64) 



Let us call this dynamics with an arbitrary initial con- 
dition Pq^uq) the pseudo-backward dynamics. This dy- 
namic does not correspond in general to a quantum dy- 
namics as (|39H . We define now the following trajectory 
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for this pseudo-backward dynamics 



n - 
n N 



m - 

* n N . 



• n-x — ► . . . - 

1 — > 



n 



(65) 



where the jumps between rij_i and occur at time 
fj = t — TN-j+i and where fij — rijv_j. Because this dy- 
namics as well as the dynamics (14011 both span the same 
configuration space, summing over all trajectories of the 
pseudo-backward process is equivalent to summing over 
all the trajectories of the original process. The trajectory 
()65JI is depicted on Fig. The forward probability of 
this trajectory is evaluated in appendix iBl and reads 



r N 



Po(n N ) 



(66) 



II exp 



dr' W T '(nj-x, m) 



exp 



W T >(n N ,m) 



We now consider the ratio of the forward (|62|l and 
pseudo-backward l|66|l probability. Noticing that the ex- 
ponentials cancels, we find the fundamental result of the 
paper 



r{t) =\n- 



ln PoM 



MF[n (f) J P (n N ) 
where the trajectory entropy flow is 

As e (t) = s e (t) - s e (0) = 



As e (t) 



drse(r) 



(67) 



Vln W ^A n ^ n ]-^) 



(68) 



In analogy with the classical results of Seifert , we can 
now derive the various fluctuation theorems by specific 
choices of initial conditions for the pseudo-backward tra- 
jectories. By choosing Po(™jv) = -Pt(^iv) and using the 
trajectory entropy 



As(i) = s(t) - s(0) = In 



Po(n a ) 
Pt(n N ) 



(69) 



Eq. I|67|l becomes 

fi F [n( T )] 



r(t) = In ^- 



where Asi(t) 
production. 



HF[n { f)\ 

Si(t) 



As(t)-As e {t) =Asi(i) (70) 
Si(0) is the trajectory entropy 



Eq. (|rJ7|) has been first derived by Crooks 01 f° r clas- 
sical stochastic processes and later generalized by others 
0, 0| . We have shown that this relation may be ex- 
tended to quantum systems. The pseudo-backward tra- 
jectories are artificial. In the classical case, because the 



time dependence of the rates is exclusively due to the 
external driving, the backward process has a physical 
meaning (e.g. 19] ). However, in the quantum case the 
time dependence of the rates is also due to the quantum 
evolution of the density matrix itself, preventing us from 
associating in general a physical process to the backward 
dynamics. 



VII. QUANTUM INTEGRAL FLUCTUATION 
THEOREM 



Summing over all possible trajectories of the pseudo- 
backward process is equivalent to summing over all pos- 
sible trajectories of the original process E« - = En, y 
By averaging (|67|l over all possible trajectories, we find 



1 = = ^2p, F [n(f) 



-r(t) 



(e- r <*>) . 



(71) 



This integral fluctuation theorem |19| is valid for any 
choice of Po{n ) and Po(^-A') in i|6"7|) . Using the fact 
that (e x ) > e^ x ' this relation also means that in aver- 
age the quantity r(t) is always non-negative (r(t)) > 0. 
Choosing Po{njy) — Pt(njy) we have r(t) — Asi(t) and 
we show again [see text below (|47|) ] that the ensemble 
averaged trajectory entropy production is always non- 
negative (Asi(t)) > 0. 



VIII. QUANTUM FLUCTUATION THEOREM 
FOR STEADY STATE 



We consider a subsystem which is subjected to 
nonequilibrium constraints and we assume that its dy- 
namics can be described by a QME of the form 134|l . 
When the subsystem is in a steady state, its density ma- 
trix does not evolve in time and the rates in equation 
(|40|l are time independent. An example of such system 
could be a two-level atom driven by a coherent single 
mode field on resonance (in the dipole approximation and 
in the rotating wave approximation) described by Bloch 
equations (see pl54 of Ref. 34]). In a steady state, the 
pseudo-backward process introduced in section IVll would 
correspond to the real physical backward process 



/M%)] = jUs[n( T )] . 

By definition, we have 

PF (R(t)) = (5(R(t)-r F (t))) F 

= Y,l*p[n{r)]S{R(t)-r F (t)) 



(72) 
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Using H67f) . we can write 

p F (R(t)) = J2^B[n {T) }e r ^S(R(t)-r F (t)) 

= ^2(M B [n (T) ]e R W6(R(t)-r F (t)) 

»H 

= (<J(i2(t)+r B (t))) B e H W 

= p fl (-fl(t)) e fl W , (73) 

where to go from the second line to the third one, we 
used r F (t) = —rs{t) which comes from (|72|l with (|67ll . 
When Po{niq) = P t (riN) and therefore Eq. (j7T)|l holds, 
Eq. (|73(l becomes a fluctuation theorem for the entropy 
production 



PF (AS l (t))=p B (-AS l (t))e As ^ 



(74) 



This relation shows that at steady state, the ratio of the 
probability to observe a given entropy production during 
a froward process and the probability to observe the same 
entropy production with a minus sign during the back- 
ward process is given by the exponential of the entropy 
production. This is the most familiar form of the fluctua- 
tion theorem. In the infinite time limit, if the subsystem 
as a finite number of levels (this condition is usually im- 
plicitly assumed in QME theory) AS(t) will be bounded 

and ASi(t) '~=°° AS e (t) so that (|74"|) also becomes a fluc- 
tuation theorem for the entropy flow and therefore also 
for the heat. For completeness, we give in appendix El 
a different derivation of a fluctuation theorem similar to 
(|74|l and which is not restricted to steady states. 



IX. HEAT AND WORK FOR QUANTUM 
TRAJECTORIES 



If we use the relation (|48|l together with the definition 
of the trajectory entropy flow (|68J) . we find that the heat 
associated with a single trajectory is given by 



(75) 



qs(jt) = P^Aseit) 

N 

= /Z (( n AHs(Tj)\rij) - {nj-x\Hs{Tj)\nj-x) 
j=i 

The interpretation of this result is that the heat flowing 
to the environment results from transitions between the 
subsystem states rij. 

The energy associated with a trajectory is a state func- 
tion and only depends on the initial and final state of the 
trajectory 

Ae s (t) = {n N \H s (t)\n N ) - (n o \Hs(0)\n o } 

N 

= w s (t)+q s {t) . (76) 



The work is therefore given by 

w s (t) = Ae s (t)-q s (t) (77) 

N 

= Yl {( n o-^s{T j )\n j - 1 ) - (rij-ilHsiTj-i^nj-i) 

3=1 

The work thus results from the time evolution of the 
Hamiltonian (due to the driving force) along the states 
rij of the subsystem between the transitions. It is in- 
teresting to make the parallel between our description of 
heat and work in the {\mt)\ basis set and the adiabatic 
basis description of Ref. [23|. In the latter the work 
comes from the evolution along the adiabatic states and 
the heat comes from the transitions between the adia- 
batic state. This can be understood by comparing (|A9|) 
and l|AH))l with (jAT2)l and (|AT3|) . 



X. THE QUANTUM JARZYNSKI RELATION 

We assume that the subsystem is initially at equilib- 
rium with respect to the Hamiltonian Hs(0) = Hs(X(0)) 
and is therefore described by a canonical distribution. 
The system is then driven out of equilibrium by turn- 
ing the driving force from A(0) to A(i') at time t' . After 
t' the driving force stop evolving. On long time scales 
after t', say t (t ^> t'), the system is again at equilib- 
rium in a canonical distribution but now with respect to 
H s (t) =H s (X(t)). 
We choose 



Po(n ) = 
Pt{n N ) = 



e -0(n o \H s (O)\na) 
e -P(n N \H s (t)\n N ) 



z, 



(78) 



where Z Q = J2 n ex P {-/3(no\H s (Q)\no}) and Z t = 
J2 n exp{-f3(n N \H s (t)\n N J). Notice that {|n }} [{|n t >}] 
is now the eigenbasis of Hs{0) [Hs{t)]- 
The free energy difference between the initial and the 
final state is given by 

AF{t)=F{t)-F{Q) = -f3- l \n^ . (79) 

Using Eq. (|75|) which defines the heat of a single subsys- 
tem trajectory, we can write Eq. I|7l)|l as 

A Si {t) = -\nP t {n N ) + In P (n ) - /%(*) • (80) 

Using now O, J73), and CZ3, we can rewrite ^ 



as 



Aai(t) = -(3AF(t)+Pw s (t) . 



(81) 



Finally, by inserting Eq. (|81|l in the integral fluctuation 
theorem l|71|) where r(t) — As,(t), we find the quantum 
Jarzynski relation 



,-/3AF(i) 



(e 



(82) 
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XI. CONCLUSIONS 



in a time independent basis and by 



We have presented a unified derivation of a quantum 
integral fluctuation theorem, a quantum steady state 
fluctuation theorem, and the quantum Jarzynski relation, 
for a driven subsystem interacting with its environment 
and described by a QME. This generalizes earlier results 
obtained for quantum systems. By recasting the solution 
of the QME in a BDME form with time dependent rate 
for the eigenvalues of the subsystem density matrix, we 
naturally define quantum trajectories and their associ- 
ated entropy, heat and work and study their fluctuation 
properties. The connection between the trajectory quan- 
tities which naturally enter our formulation and measur- 
able quantum trajectory quantities is still an open issue. 
Deriving quantum fluctuation relations without having to 
assume QME, which do not correctly account for strong 
subsystem-environment entanglement, is an exiting per- 
spective. 
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APPENDIX A: BASIS DEPENDENCE OF HEAT 
AND WORK 

We consider a system with a time dependent Hamil- 
tonian H(t) in the Schrodingcr picture described by the 
density matrix p{t) . The evolution equation of p{t) is not 
necessarily unitary. 
The energy of the system is given by 

(H) = TrH(t)p(t) = J2MH(t)\a' t )(a' t \p(t)Wt) , (Al) 



where {\a t )} is an arbitrary time dependent basis set. 
The energy changes of the system can be written as 



AE(t) EE f 

Jo 



dT 



(A2) 



= W(t)+Q(t) = W(t)+Q(t) 

where the heat and the work are given by 

Q(t) ee TrH(t) P (t) 
W(t) ee TrH(t)p(t) , 



(A3) 
(A4) 



Q{t) ee ^{a t \H(tU)j({ai\mWt)\ (A5) 

aa' ^ ' 

^(*) = T,U( a ^(t)\<))(<\m\at), (A6) 



in a time dependent basis. 

How does Q(t) [W{t)} relates to Q(t) [W(t)}7 We find 



Q(t) = Q(t)-A(t) 

w(t) = w(t) + A(t) 



(A7) 



where 

Mt) = -^t\H(t)\a' t )({aMt)\at) + {aMt)\at) 

aa' 

= £ ((« t |^)|a;) + (a 4 |^)|a' t ))(a;| / )W| at ) . 

aa' 

(A8) 

We have used the fact that (a t \a' t ) = —(a t \a' t ) which come 
hom£ t ((a t \a' t )) = 0. 

If we consider the time dependent basis set which diago- 
nalizes the instantaneous density density matrix {|at}} = 
{\m t }}, where (m t \p(t)\m' t ) = P t {m)S mm > , we have 

Q(t) = ]T(m t |i^)|TO t }P t (m) (A9) 

m 

= Q(t) - A(t) 

W(t) = J2j t (( m t\H(t)\m t ))p t (m) (A10) 
= W(t) + A{t) , 

where 



A(t) = Y,( m t\H{t)\K){<\m t )(p t (m)^P t (m') 



= J2 { (rh t \H(t)\m t ) + (m t \H(t)\rh t ) )P t (m) . 

(All) 

If we consider the time dependent basis diagonalizing 
the instantaneous Hamiltonian (adiabatic basis) {|a t }} = 
{\it)}, where (i t \H (t)\i' t ) = ei{t)5 iV , we have 



Q'{t) = X) e *C*)^f <i*|p(*)|it>J (A12) 
= Q(t)-A'(t) 

W'(t) = J2^)(it\p(t)\H) (A13) 

i 

= w(t) + A'(t), 
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where 

A'(t) = -^^Utimin) + (*t\m\n)\AU) 

ii' ^ ' 

It is interesting to notice the similarity between the two 
basis {|mt)} and {|«t}}. In both cases, the heat results 
from changes in the population of the states (and there- 
fore from transitions between states) [see (|A9|I and l|A12(l ] 
and the work from the evolution of the Hamiltonian along 
the states [see (|A10j) and (IA13|l ]. Using (jAlljl with (|A14|) 
one gets 

A(t)-A'(t) = W(t)-W'(t) (A15) 

= Q'(t) - Q(t) 

= £p f ( TO )e^)|(j<* t K}| 2 ) ■ 

Let us assume now that the density matrix of the system 
obeys the von Neumann equation 



(A16) 



(A17) 



(A18) 



U(t) = cxp + {-i / (1tH{t)} . 
Jo 

The evolution operator [superoperator] Urit) [Wt(£)] is 
unitary. In this case, the expression in the basis {\mt}} 
simplify to 



p{t) = -i[H{tlp(t)]=C{t)p{t)i 
whose solution reads 

p(t) = ti(t)p(o) = u(t)p(o)uHt) , 

where 

U(t) = exp + { / (1tC(t)} 



Q(t) = Q(t) = 
W(t) = W(t) = AE{t) 



(A19) 
(A20) 



This is due to the fact that 



P (m) = (m o |p(0)|mo> (A21) 
= {m o \uHt)U(t)p(0)U f (t)U(t)\mo) 
= (m t \p(t)\m t ) = P t (m) . 

This means that no heat is produced by the driving force 
for a unitary evolution. This is reasonable since there is 
no environment. The only way in which the energy of the 
system may increase is via the work done on the system. 
Notice that in the adiabatic basis both W'{t) and Q'{t) 
are finite for a unitary evolution. 



APPENDIX B: PROBABILITY OF THE 
PSEUDO-BACKWARD TRAJECTORY 

The probability of a pseudo-backward trajectory nt?\ 
reads 



Af[«(t)] = Po(n ) 



(Bl) 



Y[ exp ( - / df ^2 W?> {hj-i,m) j W fj (rij-i,^) 

j=l \ •'• f i-i fa ) 

exp I - / df^W^(n N ,m) , 
V Jf x fh ) 

where f = and fjy+i = t. Using and fj 

i — Tjv_j + i, we can rewrite this probability as 



Pf [n(f)\ = Pq{un) 



(B2) 



N 

JJexp 



t— Tjv-3 + 1 



df ^ W t -f {n N - j+ i , m) 



exp 



Wr N _ j+1 (n N - j+ i,n N -j) 

Using the change of variable r = t — f , we get 
Af ["(■?)] = -Po(«iv)exp df 1 ^Wr'{n a ,m) S j 

N j /"Tjv-j + 2 \ 

17 exp I - / df ^2 w r' (n>N-j+i,m) J 

j = l \ JTN-j + l m J 



w TN . 



.(B3) 



With help of j = N - j oM + 2, {53} finally becomes JOSJ- 



APPENDIX C: QUANTUM FLUCTUATION 
THEOREM FOR UNCORRELATED SUBSYSTEM 
AND BATH 

We derive a general quantum fluctuation theorem 
(not restricted to steady states) for a driven quantum 
subsystem in contact with its environment. The deriva- 
tion is similar to the derivation of Monnai in |27| and is 
given for completeness. 

We assume weak coupling between the subsystem and 
the environment and that the environment is infinitely 
large so that at all times the density matrix of the total 
system (subsystem plus environment) can be written as 



(CI) 



where p e ^ — e @ Hb /Zb is the time independent equi- 
librium reduced density matrix of the environment and 
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a(t) the time dependent reduced density matrix of the 
subsystem. Assuming the form IjClll is not very different 
from assuming that the subsystem density matrix obeys 
a QME since most of the QME derivation implicitly as- 
sume an invariant environment density matrix (e.g. the 
Born approximation |34j ) . 

Let us define the basis {\mtb)}, where {|m t )} diagonalize 
the subsystem density matrix at time t and where {\b)} 
diagonalize the time independent environment Hamilto- 
nian. The probability to go from \m b) at time to \m t b') 
at time t is given by 



H F [\m b) -> \m t b')\ 



(C2) 



(m b\a(0)p^\mob)\(mtb'\U(t)\m b)\ 2 , 

where U (t) is the unitary evolution operator of the total 
system. The probability of the backward process to go 
from \mtb') at time t to Imp b) at time by the time 
reversed evolution [2?! IsH . Eflj is given by 

fi B [\m t b') -+ \m b)] = (C3) 
(m t b'\a(t)p^\m t b')\(m t b'\U(t)\mob)\ 2 . 

We therefore have that 

fi F [\m Q b) -* \m t b')\ _ Pa{ m o) „-f3Q hh , 



H B [\m t b') -> \m a b)} P t (m t ) 



(04) 



where Po(m ) = (mo\a(0)\mo), Pt(m t ) = (m t \cr(t)\mt) 

and Qw = E b - E w . 

The entropy of a state rat is defined as 



s{t) = -mP t (m t ) . 



(C5) 



This definition makes sense because {|?n t )} diagonalizes 
a(t), so that by averaging over the different states we re- 
cover the von Neumann entropy. The entropy difference 
between the initial and the final state of the subsystem 
starting at time in |mo) and ending at time t in \mt) is 
given by 



As(s ,s t ;i) = In 



Pt(m t ) 



(C6) 



The entropy production of this same process is given by 

P (m ) Qbb' 



Asi(m ,m t ,b,b';t) = In 



Pt(m t ) T 



(07) 



because one assumes that the entropy flow difference is 
given by 



As e (b, b'-t) 



Qbb' 



(08) 



Using HU, (EH and JHHl, Eq. (E3 becomes 

In ^i'^V'r?! - ^(mo,mub,b';t) (C9) 
[iB[\m t b') —* \mob}\ 

= As(s ,s t ;t) - As e (b, b';t) . 
This result is the analog of our fundamental relation 17(J|I . 
By averaging the probabilities over all possible initial and 
final states, we get the general fluctuation theorem 

p{ASi{t)) = MK6) -> \m t b')} 

mo,mt ,b,b f 

5{ASi{t) - Asi(m ,m t ,b, b';t)) 
= ^2 VB[\m b) \m t b')] 

mo ,mt ,b,b' 

e As ^ m °' m ^ b '^S(ASi(t) - A Si (mo,mub,b';t)) 

(CIO) 



p(-A^(i))e AS ^ t ) 



This result agrees with (|74|l and is not restricted to steady 
states. This approach is based on the time reversal in- 
variance of the evolution of the total system and does 
not provide a trajectory picture. We note that in the 
total system space, the heat (or the entropy flow) going 
from the subsystem to the environment only depends on 
the end points and not on the path itself. If one derive 
a Jarzynski relation from this result as in |2?| , the work 
is also path independent. When considering the reduced 
dynamics of the system alone, as done in this paper, these 
quantities become path dependent and a trajectory pic- 
ture is provided. 
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